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ABSTRACT 

The equilibrium strategy for N-person differential games can be found by 
studying a min-max problem subject to differential systems constraints [4J. 
In this paper, we penalize the differential constraints and use finite 
elements to compute numerical solutions. Convergence proof and error 
estimates are given. We have also included numerical results and compared 
them with those obtained by the dual method in [4] . 
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JO. Introduction 

In Part I [4] , we first gave a min-max equivalent formulation of 
equilibrium strategies in N-person differential games, and used the dual and 
the finite element methods to study and compute them. In this paper, we will 
study N-person games by another important method - the penalty approach. 

The application of the penalty method to optimal control problems, which 
are just a special case of differential games, has been studied in [3] , [5] , 
for example; see also the references therein. Nevertheless, there has not 
been, to our knowledge, any application of the penalty method to saddle point 
type problems like differential games. The first main objective of our paper 
is to investigate this feasibility. Our second objective is to combine penalty 
with finite elements to compute numerical solutions and to compare them with 
those in [ 4 ] obtained from the dual method. 

We inherit some notations from [ 4 ! and define some new ones below: 


A(t), B^(t) (i - 1,2, ...,N) are, respectively, nxn, nxm^(i = 1,2,. ..,N) time- 
varying matrices; 

C i (t) (i = 1,2,...,N) are, respectively, Lxn time-varying matrices; 

M^(t) (i = 1,2,...,N) are, respectively, symmetric m.xn^ time-varying 

2 2 

matrices, which induce positive definite linear operators M. : L ** L ; 

r m. m. 

1 1 

z^(t) (i = 1,2,...,N) are, respectively, k^-vector valued functions; 


H k = H k (0,T) = {y: 
n n w 


[o,t] 


]R 


I lyl 


H 


= z 

j=o 


1 1 ( Zt )Jy l I 


l 2 (o,t) 

n 


< 00} 


N 

(DE) = x - Ax - Z B.u. 

j=l 3 J 


- f , x € H 


n 


u . 
J 


6 L 


m. 

J 


j = 1,2,. ..,N, f e L 


n 



f 


• •It * 1 o 

(DE). = x 1 - Ax 1 - Z B.u. - B.v. - f, x^H , u.€L 2 (ijK) 
i JJ 11 n J n»j 

N 2 

[DE] = Z |(DE).| 
i-1 


V i* 



“L 5 H i n & « H i ly (0) * °> 

H i 0 e H i n {y * H i i yCT) = 0} 

» 2 

u = n l 

. . m. 

1=1 l 

H i Hj n x 0 x [h*J K x U; HEL^xUx [l^]" x U 

i; "L * Lj, ix = x - Ax 

* 1 2 * • * 

L : H n L , £ x = x + A x 

nu n 


We proceed as follows. 

In §1, we present the fundamental penalty theorem. The rate of 
convergence with respect to the penalty parameters is determined. Our work 
here extends and generalizes the earlier result of B. T. Polyak [6] . 

In §2, we specialize to the linear-quadratic case and formulate the - 
finite element variational approach. Error estimates between the computed 
and the exact solutions with respect to the penalty parameter e and the , 
discretization parameter h are given. 

The relationship between the penalty method and the dual method is 
explored in §3. Their computational advantages and disadvantages are also 
compared . 

Numerical results are presented in §4. 
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§1. The Penalty Method for N-Person Differential Games. Rate of Convergence. 
As in [ 4 j, for an N-person game with linear dynamics 


— x(t) = A(t)x(t) + B^(t)u^(t) + ... + B N (t)u N (t) + f(t), 0 < t < T, 


( 1 . 1 ) 


x(0) = x Q « ® n , 


let each player have an associated cost functional J^(x,u), 1 < i < N, which 

is continuous with respect to (x,u) in the H^xU norm. Throughout the 
rest of the paper we assume that we have made the change of variable 
x(t) -*■ x(t) - Xq so that x(0) = 0. This change of variable results only 
in minor changes of J^. 

In this section, the costs need not be quadratic. 

Following the min-max formulation in [4,§l], we consider 

N . . 

SU P J(x,u;X,v) = Z [j.(x,u) - J-Cx^v 1 )] 

(x 1 ,v 1 )€hJxL 2 i=1 

On m. 

(DE) t =0 * 

lgi<N 


( 1 . 2 ) 


inf 

(x,u)€h1: xL 2 
On m. 

l 

(DE)=0 


where v 1 = (u^ju^j • • • ,u^_^,v^,u^ + ^ , . . . ,u^) € U. Here, we see that (DE) = 0 
and (DE)^ -0(l<i<N) are N+l equality constraints for the inf-sup 


problem (1.2). Thus, it appears natural for us to penalize the problem as 


(1.3) 


inf 


sup 


(x,u)€Hj n xU (X,v)e[H 1 Q JxU 


J (x,u;X,v) = J(x,u;X,v) 
£ 


+ i||(DE)j| 2 2 - Z ^ ||(DE)|1 2 2 

0 L i=l i i L 


for some e Q* e l***** e N > 
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The most important question remains in determining the validity of the 
above scheme and, if valid, its rate of convergence. Thus, we consider the 
fundamental theorem of penalty for N-person differential games below. 

The following assumptions will be needed: 

(Bl) J(x,u;X,v) is strictly convex in (x,u) and strictly concave in (X,v); 

(B2) inf sup J(x,u;X,v) is attained by (x,u;X,v) € H; 

U.uX-H^xU (X,v)€[hJJ N xU 
(DE)=0 [DE]=0 


By (Bl), this point (x,u;X,v) is unique. Also, by [4, Theorem 2 . l] , 
there exist Lagrange multipliers p^, p = (p^,...,p ) such that 

A A A A 

(1.4) J(x,u;X,v) = min max J(x,u;X,v) 

(x,u)6Hj n xU (X,v)6[hJJ N xU 
(DE)=0 f De] = 0 


= max min min max [j(x,u;X,v) 

P 0 €L n 


N 

+ <p 0 , (DE)> + l < P£, (DE) i >] 

i=l 


(B3) The costs J^(x,u) are of the form 

T 

(1.5) J^(x,u) = /^h^(x(t) ,u(t))dt 

so that p 0 € H^ 0 , p € [h^ 0 ] N ; 

(B4) The first and second derivatives J', J" exist, and J" satisfies the 
global Lipschitz condition 

(1.6) | j J'^x^u^X^.v^ - J"(x 2 ,u 2 ;X 2 ,v 2 ) j | s Kj [(x^x^u^jX^X^v^) 


for some > 0 uniformly for (x 1 ,u^ ;Xj. ,Vj^) , (x 2 ,u^ ; x 2 ,v 2^ . 
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(B5) Let = 3 X J) 4 ~ <3^ J, = cj J, and := 8 (i) 2 J be r.^ccnd 

order Frechet partial derivatives evaluated at (x,u;&,v). Then > ??Zq > ^ 

and are positive definite linear operators on L 2 , U, [l 2 ]^ and U, 

respectively. Furthermore, <A Q x#^ maps x [H* n ] N .into itself; 

(B6) are small relative to <* a ,n 0 .-<A i and (cf.Cl.24), 

(2.10), (2.14)) 

(B7) The mixed Frechet partial derivative operators 3 3 J, 3 3 J,..., etc., 

X a X u 

A A A /\ 

evaluated at (x,u;X,v) are all 0. 

Remark 1.1 

(i) In (B3), that the J^’s are assumed to be of the form (1.5) is only 
for the convenience of discussions. 

(ii) Making some other assumptions, one can relax the global Lipschitz 
condition (1.6) to a local one. 

(iii) (B7) is assumed here only for the convenience of discussions, cf. 
Remark 1.5 later. 


Theorem 1.2 Under conditions (Bl) - (B7), for £^,eL,...,^> 0 sufficiently 

A A A A 

small, there exists a unique (x^_,u^ ;X e ,v £ ) € H satisfying = 0 such that 


(i) | |(x ,u ;X ,v ) - (x,u;£,v)|J_ < K ( max e)||(p,p)|| 

H 0<j<N J 0 L 2 x[L 2 ] N ; 


(ii) | I- <i e “ Ai e - z B.u e . 


" f) ~ Pol I 2 + . L I 

L 1=1 


— (x* - Ax* - £ B.u . 

£ i j*i J 6J 


-B.v . - f) - (-p.)H _ < K- ( max e 

1 £1 1 L 2 J 0<j<N 

n = = 


j)l I (P 0 ,P)I | 2 . 2-j N ’ 
L n x l L 3 


for some K 2 , K 3 > 0 independent of e Q e 



Proof: 


We introduce the new variables 


= x - x 


5 , = X - x 


(1.7) 


^0 


u - u 


n L ■ v - v 


N 


s 0 * * ** - Vi - £) - p 0 

?i - - fti 1 - Ax 1 - I B.u. - B. V. - £) - p. , C, = (tj,? 

e i jf*i J J 1 1 11 


In the above, we first choose x 6 fl Hq^, X f [h^ fl 


n " 0n J 


N 1 

u,v € U H II H and then let (x,u:X,v) tend to an element in H. 

. , m. 

1=1 i 


We further let 

K = ^ 0 ’ ? i }> n = ( VV’ c = (c o’ c i ) - 

For any (<Sx,c$u;6X,5v) € H, we have 
(1.8) J^(x,u;X,v) • (Sx,Su;<5X,<5v) = J'(x,u;X,v) • (5x,5u;5X,6v) 


+ — <x-Ax-Z B.u. - f, Sx - A(6x) - Z B.(6u.) > 
e n .11 .ii 

o i i 


+Z-<x 1 -Ax 1 - z B.U. - B.V. - f, Sx 1 - ACSx 1 ) 


i £ i 


j n 


J J ii 


- Z B . 6u . - B . 6v . > 

jH J J 11 


We can use (B4) to write 
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(1.9) J'(x,u;X,v) = J 5 (x,G;£,v) >• J"(x,u;X,v)(t i0 ,Tl 0 ;5 1 ,n i ) + r(£,n), 


where the remainder r(£,n) (as a linear functional in H) satisfies 

(1.10) r(0,0) = 0 


( 1 . 11 ) 


r'(l.n) - r'(5,n)|| 2 C .11(5 - C,n - n) 1 1 

1 (lx [l j") x(uxu) 


n 1 n J 


V(^,n) , (S.fi) € (Hj n X (H^ n ] N ) X (UXU). 


Substituting (1.9) into the first term on the RHS of (1.8) and integrating 
the remaining terms by parts, we get 

( 1 . 12 ) LHS of (1.7) = (j'(2,G;X,v) + J"(x,G;X,0)(^ o ,n o ;5 1 ,n 1 ) + r(5,n)] • 

(5x,5u;5X,6v) - < (4r + A) — (x-Ax-ZB.u. - f), <$x> 

dt e n .ii 

0 l 

+ f- < x(T) - A(T)x(T) - 2 (B.u. ) (T) - f(T), 6x(T) > 

C 0 i 1 1 ]R n 

- Z<B. • ■§— (x - Ax -iB.u. - f), 6u. > 
i 1 £ 0 11 1 

+ 2 < (*TT + A ) • ~ (x 1 - Ax 1 - Z B.u. - B.v. - f), 5x^ > 
i l Jfi J J 


- 2 | - < x 1 (T) - A(T)x 1 (T) - 2 (B.u.) (T) - (B.v.)(T) - f(T), 

i £ i jfi J J 11 

+ Z Z < B? • (x 1 - Ax 1 - z B.u. - B.v. - f), <5u, > 

i kH k e i jH J J 1 1 ^ 


+ Z < B. • — (x* - - Ax*" - Z B.u. - B.v. - f), <5v, > 

• 1 £• • .x • J J X 1 iC 

1 1 Jfl J J 


dx^T) > 

m n 


We now substitute (1.7) into the above and note that 
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(1.13) 


A A A /S 


J'(x,u;X,v) • (<Sx,6u;<SX,6v) - <L p n ,£x> - £<B. p , <Su. > 

v • X vl X 

1 


-Z < Z*p,. .Sx 1 > - l l < B*p ,<Su. > - Z < B?p. , 5 v.>=* 0, 

1 1 j? 4 ! J 1 


we get that the solution of J'(x,u;X,v) = 0 can be found by solving 
(1.14) [j"(x,u;X,v)(C 0 ,n o ;C 1> Tl 1 ) + r(£,0)] * (<$x,<Su;<Sx,<Sv) - <4 *Sq, > 


■Z < B? C n ,5u •> - Z<Z,C*<5x > - Z Z < B*C*<Su. > - 2<b?C?‘,6v. > 

i 0’ i . 1* . ... j 1’ j . l 1* i 

l ii jfi J J i 


Note that all the <, > terms on the RHS of (1.12) disappear because of 

H n 

the arbitrariness of 6x(T) and 6x 1 (T). By (B5) and (B7), we have 



o 

o 

o 

o 

\ 


5 ° 


0 cflj o 0 


5, 

15) J"(x,G;X,0)(C o ,O 0 ;C 1 ,n i ) = 





O 

o 

£ 

o 

o 


n o 


r 

O 

O 

O 

S 

\ 


V 


Therefore, from (1.14), we get 


[ <fi(y*Q Vo 


(1.16) \ 


/*ri 


- i 0 ?I - - r 2 < 5 - n) 


- B I C 0 - “ft 

J! 1 ! 


C5,n) 


( ^w 1 - hi = - r 4 ( ^ n) 


» 1 < i < N, 
, 1 < i < N, 


where r^, r^, r^, r^ are the respective components of r(5,n) and the 
superscript i denotes the i-th component. 
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Combining (1.16) with (1.7.5) and (1.7.6), we get the following nonlinear 
"matrix" equation 



We further abbreviate (1.17) as 


(1.18) 




' -r^S.n) ' 
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where 


dJ = 

fi 0 

0 

. u= 

% 

0 ' 

A 

til 

0 



0 



■ L 

0 ' 




\* * 0 1 

1 = 

L 

• 



t 

- 

L ~ 

L 

• 


.0 

* L . 

(N+l)x(N+l) 


♦ * 

Lo L 


<01 0 ' 
fiz <$ 3 . 


(N+1) X (N+1) 


I 


e 




0 


0 


1 



j (N+1) X (N+1) 



£ 1 - 



'^(£,11)' 


■r 3 a, 1 1)- 

^<5,1)5 


. r 2 (C,n) = 



.r 2 ( C,n) 




L T p N J 

By (A5) , D is a closed linear operator on (L^ x [l 2 ] N ) x (UxU) x (L 2 x [l 2 ] N ) 
& n n n n 

with domain dom(D £ ) = (H^ x [lljj N ) x (UXU) x (H* q x [h^JV 

Lemma 1.3 Under conditions (A5), (A6) and (A7), for all eQ,e^,...»e^ > 0 
sufficiently small, the operator introduced above has an inverse and 




for some > 0 independent of , . . . , e^. 
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Proof: For an arbitrarily given (oi.S.y) € (L 2 x [i/V') x (UxU) x (L 2 x [*L 2 ]^). 

— — — n n< n * n* 

we wish to find some € (H* x [h 2 ] N ) x (UxU) x (H* x [h* J N ) 

On On* nO n(f 

such that 

f I 

i _ 

n 

l 

or, in detail, 

~ Z*5 = ot 

( 1 . 21 ) \fllr\ +< 5*5 ■ 0 

_ll -k£u + I e ? = Y- 

Let $(t,s) be the fundamental n x n matrix solution satisfying 

*<t,a) = A(t)4(t,s> . 0 < a < t < T 

4<s > s) * I nxn* 

It is easy to see that L is invertible with inverse 

’ $(t,s) 0 

~ -1 t 

(i ) h . f 

. 0 $(t,s) 

(N+l)x(Nxl) 

Thus, we have from (1.21.3), 

(1.22) l = (Z)** 1 t$n + I £ 5 - Y). 





Substituting (1.22) into (1.21.1), we get 
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jTk n + WZ' 1 !, - f)Z “a +0<7 




The integrodif fereatial operator i -</!l I is easily seen to be invertible 

e 

for e = (£q > » • • • > e^) sufficiently small, thus we have 


(1.23) 


5 = (l L 1 I ) 1 [fjL ^8 n “ (a +d L i y)] 


,7-1 


Substituting (1.23) into (1.21.2), we get 

[ttl+ <&*(Z* -tf7Z _1 i e )"^Z“Js]n = & + <£f(Z* +rfZ~\)- 

Now we invoke (B6): since Jit is invertible, if is relatively smaller 
than 3 ? I such that 

(1.24) tfl+ ($ Cl ~(flL 1 I £; ) bZty is invertible 


(for £ sufficiently small), we have 


(1.25) n =J ~ l [6 +$*Z e 1 (a +<fll~ l y)}. 

where 

(1.26) J z = + -cA~l 1 i z )~\4 2 e = Z*-rfZ _1 V 


Using (1.25) in (1.22) and (1.23), we obtain 


5 


Z~ l {[$3~ 1 <£l~ 1 + irt rW'ZI 1 - I)]a + 

£ C c £ £ 



Ve 1 °' r H 1 i | 


+ 1 - r + i~L~ t }y'fk<£r l z - i^z _ 1 ]y} 
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l - I " 1 {VTiT^Tz - Da +dr<bJl 1 & * - DdfZ'S'}. 


Therefore, 


D is invertible, with 





f-1 * — 1 

K <bl c 


r 1 ^ 1 ♦ v? 

-jirMi 1 ) 

fe 


- d otfZ'fo /; 1 


L - I + I £ Z 

•wZ'fe^z -1 - ntfZ -1 ] 

J;Vz;S»r l 

wZ“<fec8*Z^ - i^Z -1 


Since each entry of the matrix D ^ is bounded, we have proved that D^ 

is bounded for £ sufficiently small. 

We will need the following lemma from [6] : 

Lemma 1.4 Let be a given Hilbert space and T be a densely defined closed 
linear operator from dom(T) c H onto 31 with a bounded inverse || T ^|| < c^, 

* 

and let r(x) be a nonlinear (Frechet) differentiable operator on % such 

that r(0) = 0, |jr'(x)|| < c^H x j| for all x € X. Then for any a € H , 

|| a || £ — 5 — > the equation 

4 c 1 c 2 

Tx = a + r(x) 

has in the sphere ||x|| < 4c^ || a || a unique solution x € dom(T) satisfying 



We note that although in [6, p.6. Lemma l] , it is assumed that T be 
hounded , a careful examination of the proof shows that that assumption is 


redundant . 
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Using T = D , c.. 

X 


K 4 and c 2 


in Lemma 1.4 and applying it to 


(1.13), we obtain that for 



1 • 1 

4 K K 2 
4 1 4 


t 


which is clearly satisfied if 


min |- > 4 K K 2 || (_p p)|| 

0<j<N £ j L 2 x[L 2 lN 

n 1 n J 


(i. 20 ) has a solution « [hJJ"* 1 * 0 2 x [h ^] B+1 3atlsfylng 


K. 


II ce e .n e .c e )|| 2JB+1 2,H*1 S 4 (m “ 

1 n J 1 n- 


0<j<N 


£ j ) II II [ l 2]N+1 


From (1.7), writing 


/V /\ 

x e ~ x 

A 

/\ 

* X e = 

/S 

x + 

A 

Vi * 

A A 

A 

/V 

A 

A 

u e = u 

+ Vo 

’ v e 

V + 

Vi » 

2 A 

r (x e 

- A£ e 

- Z B.u . ■ 

- f) 

A A 

= C A + P 0 

e .0 






B.u 


J e »J 


- B.v . - f) = 
i e,i 


>• ■*» 

~ C e,l ~ p i ! 


1 2 i S H. 


we obtain that for 


max e . < 

0< j<N J 


[ 2K l K 4l|(P 0 >P>ll 



C II -p Q »p) II = II Cp 0 ,p) II ) , 



a point 


(x ,u ;X ,v ) € Hi x U x [h^ ] W x U has been found for which 
c e e £ on 1 on' 


,1 lH 


J'(x ,u :X ,v ) 3 0 and 
£ £ * £’ £ * £ 


X " X || 

L 

n 


/N A ^ ^ 

II ^£,0 II l 2 - II ^£» n e* C e^ll ^ L 2jN+l xlJ 2 x ^ L 2jN+l 


K, 

< ( max £•) II (p 0 .p)|| 2 N+1 ; 

0 <j<N J 0 [L “] N 1 


similarly, 


A /\ 

U £ " U l U * 


4 ( o »« « 3 >ii <p 0 .p>u 


K 


11 ^ - X H [ l 2]H i 4 ( o<]^ V 11 (P 0’ P)|1 [ l 2jKU 


a J 


/\ A 


II v £ - v ll u * T 


( max e 
0<j<N 


j)|| (P 0 »P>II ^ 2 jN+l 


K, 


— (x £ -Ax £ -E B.u £>i 


f) ” P 0 II 2 < -r ( max e.) ||(p 0 ,p)ll 
L °<i< N J 


(xi - Axi - z B.u . - B.v . - f) - (— p - ) II „ 
G i ^ ^ j^i J £>J 1 e* 1 1 11 L 2 


S T ( “\ e j > II <P 0 *P > II ,2,11+1 • 

°<J< N l L ni 


The proof of Theorem 1.2 is complete 


a 
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Remark 1.5 From the proof given above, we see that assumption (B7) can be 

relaxed; we need only require that the mixed partial derivative operators 

3 3 V J,3 3 J,...,etc., be dominated by 3 2 J, 3 2 J, 3^» at (x,u;X,v). 
xX xu x’u’X’v *399* 

a 


Remark 1.6 Although J £ (x,u;X,v) is concave in (X,v) for all , . . . , e^, 

in general it is not necessarily true that J £ (x,u;X,v) is convex in (x,u). 

Thus (x £ ,u e ;X £ ,v £ ) need not be a saddle point for J e . Compare Lemma 2.2 later. 

D 

Corollary 1.7 Under the conditions of Theorem 1.2, assume, in addition, that 
J(x,u;X,v) is quadratic in the sense that 

J(x,u;X,v) = J(x,u;X,v) + 2J'(x,u;X,v) * (x-x, u-u; X-X, v-v) 


+ < J"(x,u;X,v) * (x-x, u-u; X-X, v-v), (x-x, u-u; X-X, v-v) > 
holds for all (x,u;X,v), (x,u;X,v) € hJ x U x [hJJ N x U. Then Theorem 1.2(i) 
can be strengthened to 


(1.27) II (x e ,u £ ;ft £ ,v £ ) - (x,u;X,v) 


H * 


K' ( max 
0< j<N 


Ej)ll (P 0 .P)II , 2 -iN-H 




for all e o ,£ 


sufficiently small. 


Proof: Since 

of Theorem 1.2. 


(1.28) 


J is quadratic, so is J £ . 
By (1.18), we have 



Therefore r(£,r|) = 0 in the proof 


Thus 


. * . A ^ A . 

II D £ ^e> r le»Ce) | 


[l 2 ] N+1 xU 2 x[l 2 ] N+1 
1 n J L n J 



[l z ] 

1 n J 


2i N+l 
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For e 0 ,.. 

k 5 , k 6 > 0 

(1.29) 


sufficiently small, it is easily seen that there exist 
such that 


Kg U (5,n,«|| 


[l 2 ] N+1 xU 2 x[l 2 ] N+1 


II D £ (C.n,;)|| 2 . 2 in+i 2 

[L I xU x 
1 n J 


2iN+l 


t<l 




for all (£,n,S) € [H^ n ] N+ ^xU 2 x [ h^]^ + ^ , thanks to the coercivity 


^r-l iH+1 - K 7 l! ^11 2 r „l iN+1 


KJ 


[“5nl 


‘* £ H ! r..l i»*l - K 7 II C II t,.l 


[\ol 


! H no! 


N+l 


Combining (1,28) and (1.29) with Theorem 1.2(i), we conclude (1.27), 


§2. Penalty for Linear Quadratic Differential Games. Finite Element Error 
Analysis. 

For each (the i-th) player, we let his cost functional be of the same 
form as in [4] : 


J^(x,u) 



z^(t)| 2 + < M^(t)u^(t) , u^(t)>] dt. 


By (1.3), we have 
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, N T 

(2.1) J (x,u;X,v) “ y Z / [|c.(t)x(t) - z-(t)j 2 + < M.(t)u.(t), u.(t) > 

i**l 0 1 ill 


- |c i (t)x 1 (t) - ( t ) | 2 


< , v^ ^ t ) >] 


+ 7 || x - Ax - Z B 

£ 0 i 


• u. - £ || 2 - ? ± 


- Ax - 


Z 


B .u. 
J J 


- B.v. 

l i 


- fil 


Consider 

( 2 . 2 ) 


min max J £ (x,u;X,v). 

(x,u)€Hj n XU ( X ,v)x[hJJ N xU 


Using Che notations in §1, we have 

d>o - 3 x 3 ' c t c l * •"* V: 


N 


^ - 3 i j - - 


* 

°i c i . 


* 

c c 

N N 




- 8 2 J 
u 


M 


1 . 


>m nJ 


r\ = K J 



From now on, assume that the operators C^C^, 1 < i < N, are all invertible. 

Then , 7^ and - 3 ^ are positive definite, and (B 5) will be met. 

For any given (x,u) € x U, define 


(2.3) J £ (x,u) = max J £ (x,u;X,v) 

(X,v)€[hJJ N xU 


if the maximum is- attained. 
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Lemma 2,1 (i) J £ (x,u) in (2.3) is well-defined. 

(ii) If are relatively smaller than then J £ (x,u) is strictly 


convex in (x,u), and 
lim 

II (x,u) 


(2.4) 


hJ; x u 

On 


Consequently, 


mm 

(x.uJCH^xU 


J (x,u) » + °°. 

O 


J £ (x,u) has a unique solution. 


Proof : Since J £ (x,u;X,v) is strictly concave in (X,v), negatively coercive, 

i.e. , 

lim J (x,u:X,v) = - °°, 

II (X,v)||- £ 

we see that for any given (x,u), max J £ (x,u;X,v) is uniquely attained at some 

(X,v) 

A A 

(X e (x,u),v e (x,u)). Solving max Je(x,u;X,v) is equivalent to solving 

(X,v) 

£ 1. i * 

(2.5) max - 2 . . • u i_ l » v ii u £ +1 » . . . , 1 ^) + — || x 1 - Ax 1 

(X.vXEfH^xU 1 1 

- Z B.u. - B.v. - f || 2 ]. 

j^i 3J 11 

For any given u^,...,u^, we choose x ,...,x ,v^, v 2 > “ ,,v n-i anc * v n suc ^ 

(2.6) x^ - Ax* - Z B.u. - B.v. - f = 0, x*(0) = 0, i = 1,2 N. 

jH 3 J 11 


Then 


- Z [j £ (x , u^ , . . . ,u i+l * * * * + e 1 1 x “ Ax 


i=l 


« • • ■ 
1_ II ~i .~i 

i 


- E B.u. - B.v. -f || 2 ] 
j/i JJ 11 


(2.5) > 
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= ~ E J^(x ,u^ , . . . » u £_^ » v £ ,u i+l * * * ' ,U N^ * 

From (2.6), we have 

x*(t) = / $(t,s) [ 2 B.(s)u.(s)]ds + / 4>(t,s)[B. (s)v. (s) + f(s)]ds. 

0 jji£ J J 0 xi 


Thus 


(2.5) > J^(x ,u^ , . . . , u £_^ , > u £ + ^ » . • • »Ujj) 


= ~ 2 {|| C. ( S $(t,s) [ 2 B.(s)u.(s)]ds + / $(t,s) [b. (s)v. (s) 
i 1 0 j?ii J J 0 


+ f (s)]ds) - z i (t)|( 2 + < M i v i ,v^>} . 


Hence 


J (x,u) = 2 J.(x,u) + ^— || x - Ax - 2 B.u. - f|| 2 + (2.5) 

E i 1 E 0 i 1 x 

> ( 2 [ ||C.jc - z. || 2 + < M.u.,u.>] + || x - Ax - 2 B.u. - f|| 


- I|C. / $(t,s) [ 2 B.(s)u.(s)]ds|| 2 } 

10 J J 

t t 

- 2{ £ < C. / $(t,s) 2 B. (s)u.(s)ds, S $(t,s) [ b. ( s)v. (s) + f(s)]ds>} 

iiO 0 Lii 

+ remaining terms involving only v^ and f. 

As || (x ,u) || . -*■ 00 , the first parenthesized term, which is quadratic, 

^n XU 

dominates the second. Since we have assumed that are positive 

definite and sufficiently larger than B^, — ,B N , we see that the first 
parenthesized term is positive definite in u^,...,u^. Hence (2.4) is proved, a 



Lemma 2.2 If B^,...,B are relatively smaller than such that 

J e (x,u;X,v) is strictly convex and coerive in (x,u) for each given v, then 
the saddle point property 


(2.7) “in “ax J (x,u;X,v) 

(x,u)€Hq r xU (X,v)€[Hq p 3 xU £ 


max min J £ (x,u;X,v) 

(X,v)€[h^J N xU (x.u^H^xU 


holds for all e. 


Proof : We know that J £ (x,u;X,v) is always strictly concave and negatively 

coercive in (X,v). From the proof of Lemma 2.1, we easily see that when 
are relatively smaller than J £ (x,u;X,v) is 

strictly convex and coercive in (x,u) for each given (X,v). 

The saddle point property (2.7) follows in the some manner as the proof 
of Theorem 4.4 in [4] . 

Now it is not hard to see that all of the assumptions of Theorem 1.1 are 
met, and by Lemmas 2.1 and 2.2 we see that the saddle point (x^jU^jX^.v^) 
is determined by solving 


3 J = 0 , 

I (x £ , u £ j X £ , v £ ) 


3 J =0 

u e|/ A ^ c a » * 

I (x £ ,u £ ;X £ ,v £ ) 


3 J 
X £ 


• A A A A . 

(x e’ u e ;X e’ v e ) 


3 J 
v e 


. A A A A . 

(x £ ,u £ ;X e ,v e ) 


0 • 


Thus we can make a direct variational analysis on 


J 

£ 


and obtain 
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J'(x ,u ;X ,v ) • (6x,6u;6X,6v) “ 0 
e £ e e e 


N 


2 [ < C.x_ - z. ,C. (6x) > + < M.u . ,<$u. > - < C.x* - z. ,C. (tSx 1 ) > 

u i £ r’ i i e,i i i £ i* i 


- < M.v . ,6v.>] + — <x - Ax - Z B.u . - f,Sx - A(<$x) - ZB.(Su.) > 
i e,i* i 1 £o e e . x £,i * i i 


Z <x£ - AXp - Z B.u . - B.v . - f .ax 1 - ACSx 1 ) 

i-1 e i e e J £ »J 1 e * 1 


- 2 B.(5u.) - B.(5v.) > 

j?ii J J 


for all (<5x,<5u;<5x,<5v) € H^ n x U x [h^ ]** x U. This gives the following 
variational equation 


( 2 . 8 ) 


a e ( 


^ 1 
X 

e 


'6x " 


' 5x ' 

*£ 

J 


) = e c ( 

<5u 

^£ 


6X 

£ 

5X 

A. 


6 V 


6v 


) , 


where a is a bilinear form defined by 
£ 


a ( 
£ 


Cl 

hi 

Hi 


v 


i J 


C 2 

h2 
= 2 
V 2 


N 

) = 2 [<C.£ ,C.5 > + <M.u u 

i-l 12 i l|l 2,1 


- <C.E*-, C.SS 

l 1 12 


" <M l V l,i’ V 2,i > 1 + t 0 < h " A h ~ i B i y l,i*^2 " A h " f V2*! 5, 


A • ' • • • 

- 2 — < - AS^ - Z B . y . - B.v. . , 5* - AS~ - Z B.u 0 . - B.v. . > 

i e i 1 1 jjti J l.J i l.i 2 2 ^ J M 2, j i 2,i 


and 3 is a linear form defined by 
£ 



5 

u 
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e e ( | s p 3 2 [< z v C^> - <z.,C i H 1 >] + ~ < f > 5 “ A£ - Z B.y. 


A • • 

- Z 7 - < f, H 1 - AS 1 - Z B.y. - B.v. >, 
i e i jH 2 J 1 1 

for (5,U;H,V), (C 1 ,U 1 ;H 1 ,V 1 ) and (C^h^.vp € H J^XUX [ H N XU . 

We assume that 3r > 0 such that for all e sufficiently small, a £ 


(HI) 





V 

t 

V 

inf 

sup 

a p ( 

Hi 

i 


'5* ' 


'Ki' 

e 

=1 


“2 

h 2 


hi 


yi. 


- V 2- 

“2 

f— 4 

n 

« 

Si 

sc 

ii 

•-* 



, V 2 - 


. v i . 





) > r > o. 


How realistic is the above assumption? This is partly answered in 

Proposition 2.3 If are comparatively smaller than 

then (HI) is valid. 


Proof: For any given (£^,y^;S^,V^) € H with unit norm, if we choose 

H 1 € ^J N Such that 

M • W • • • 

(2.9) 5* - AS* - Z B.y, . “ B.v. . - -aj + AH? + Z B.y. . + B, 

11 3 1.3 i 1.x 1 1 ^ j H l,j 1 


thus 


• t 

sht) =* -s}(t) +2 / $(t,s) [ Z B.y. . + B.v. .jds, 

* 1 0 jjti 1 A >J 1 1 » x 


satisfies 


V 



+ 
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then 

( 2 . 10 ) 


But 


sup 

5 2 

U2 

H 2 

V 2 


a ( 
e 


U =1 


Ki 


* 62 ' 



‘«t‘ 



4i 

-I 


42 

-2 

) > 

1 

4i 

Hi 


ai 

9 

II (Ci ,Vr;Si,-Vj)|| H % ( 

9 

.Vj. 


. V 2. 



yi. 


,»i. 


II (5i,Wi;Hi,-v x )|| H i=l 


{ j [< O l5l . C i5l >*< M. Ul> . , M m > 


. , . t 

M 2 ! - 2 i Hc - s) <.j. * Vi,i )ds > + < Vi.i* v i,i >] 

- II «1 - - 1 Vi.i'l 2 * l It II 2 i - A3 i - J. Yi.i - Vi.ill 2 


\ 4 °x-f c i 5 i - 20 i^ (t > s) <.*. Yi.j + Vi.i M> > 

> Z[|| C e\\\ 2 - h\\c SM| 2 - 2 ||c. / *(t,a) ( 2 Bp +BV )ds|| 2 ] 

£ 1 A 1 1 1 0 jj4£ J 1 i > 1 

= % 2 lIc.sHj 2 - 2 ?||C. S H t,s) ( 2 BP + B V ■ )ds || 2 . 

£ 1 1 1 1 0 jjt£ j i »J 1 i » 1 

The second term above can be absorbed into a fraction of 

2 [<M.p. . , y. . > + < M.v, V. •>] provided that M. , . . . .IL, are comparatively 
larger than B^,...,B N> i.e., we have 

(2.U) LHS of (2.14) >. || g I -.y 1 g i ' Npir, ' ' Bt jj t<C i 5 l’ C i E l > 

Vl,i- **!.£ > * < °i 2 ^ c i 2 l > * < Vl,i- V l,i >4 I" II ^ 


+ < 




for some a: 0 < a < %. 
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Let 0 6 (0,1) be fixed. For the terms on the RHS of (2.11), if 
(^.y^jEj^Vj.) satisfies 

eT Us 1 “ A h “ ? Vi.JI 2 - ^ h " a M 2 » 


( 2 . 12 ) 


7: ' . Z H B jh,j - Vi.J 2 s 3| l n - A 5 ill 2 * 1 


1 , • . • ,N, 


then we easily observe that 

(RHS) of (2.11) >F>0 , for some T independent of ( ^, V^; V^) , 

is satisfied. 

If, on the contrary, say, for i = 1, we have 

N 


(2.13) 


^IIV A = 1 - .^Yij-ViJI 2 sM§i-«‘||*, 


while the rest of (2.12) remains valid, then (2.13) gives 


(2.14) ||HJ- AHJII 2 ♦ II I * BjV^jll* < Bejl*- A=‘|| 2 ♦ 2 < X 

J = 2 


N 


2 B.lu , + B,V > 
jl 2 J !»J 1 M 


N N 

a-Be 1 )||Sj - AEJII 2 + < y|SJ - AS1|| 2 + 411 + Vl.l 1 


N 


(1 - Pe 1 - h) llfi 1 - AS 1 !! 2 <3 II 2 + B^ J 


Hence 


11 j 2 + Vl.lH 1 2 J a - - 5> lls} - **{11 


= 1112 


Because M^, 1 < i < N are positive definite operators considerably larger than 
B., 1 < i < H, to have 


ID* 
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(2 


•15) a'? Ui,i> + <M i V 1>i ,Vi fi ] > || ? B jPl>j + B l v 1}1 


for some a';: 0 < a' < 1. Therefore, for some a" < a» a" > 0» we have 


(LHS) of (2.11) > 


a"{2 [<c i C 1 ,C-5 1 > 


^ ^l» y ii“l»" V l ) ll H 

+ < Vl.i 1 M l > i > * <C i E l’ “i 2 !* + < Vl,i’''l,i >] 

+7-11 Cl - AC - S B y II 1 ♦ Z e|lij-A=j|| 2 

i x i 1 £=2 1 L 

+J (1 - BSi -i)||Hj-AHj|| 2 }. 

Hence the LHS of (2.11) is again > j* > 0 for some p, independent of 
( ’ y l 5 “i * V l^ and e 0’‘*' ,£ N* Tb 61 ^ 01,6 (HD is realistic. □ 

We now let c H^(0,T) be a (T q , l)-system ( [l] , [ 4 ]) and let 

S?" c (0,T), i = 1,2,...,N be (T,0)-systems , and denote 
n m. " 

1 


(2.16) 


N N N 

s. = x ( n st) x ( n sr) x ( n s*) 


i=l 


i=l 


i=l 


We assume, furthermore, that 


(HJ) inf 


sup 


f r h 1 
^2 


'S' 

h 

^2 

II =1 II 

u i 

„h 

II H 1 ‘I 

-h 

“2 


“1 

• V 2 


- V J- 


a- 


H 


=1 


r^h i 


_h 

h 


^2 

h 


h 

**1 


^2 

_h 

* 

_h 

“1 


“2 

h 


h 

L v i 


L 2 


) ^ r h > r > 0, 


Vh, 


wherein (^,u^;5^,V^) , (^2»h2 ; “2 ,V 2^ € S h' IC shou l d be noted that if 
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are sufficiently small compared with then (H2) is 


also valid. 


We consider 


(2.17) 


n N UN. 

(x,u)€s^x( n sj) (x,v)6( n sj)x( n sh 

h i-i h i=i h i=i h 


J e (x,u;X,v). 


Arguing in the same manner as in the early part of this section, we see that 
(2.17) leads to finding the solution (x £ ,u £ ;X £ ,v £ ) of the variational equation 


(2.18) a £ ( 


/ 'h * h 

u c flu 


x£ 5x h 


) = 0 C ( ), (<5x h ,6u h ,5X h ,6v h ) 6 S. . 


Let * {c^ 1 } 


, X N *N 


i 0 =l 1 ii=l N Si 1 


be a basis for S? x S. 1 x ... x sj. 

n n n 


Then (2.18) is a matrix equation q, = 0 £ , where the matrix and the 


vector 0 £ have entries 


= a £ (4'£»4 , j) » ^£>4^ € 

\ (^ 1 ,...,^ N ), ($J\ 'pj?..., $q N ), (^ 1 »$2 2 »*-*»^I N)) 


'K - (^q° » (^\...,<JT ? ), (^\ $q 2 » • • • »^q N) j 


(§“).» V 


for all 


i, j : 1 < i, j < (N + l)I n +2 Z I., where in the above, 

U j=l J 
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¥ 0 * 


* 




0 ’ 


i 




» 


♦o 1 " 


U I, 


i, . i. 


•A e (m 1,, 1 In 
t N € W N >i -I' 
n 


h.h 


* 


'N 


N ’ 


*? = 


we can write 

m£(i,D 

M^(l,2) 

M^(l,3) 

Mg(l ,4) 

i^(2.1) 

M^(2,2) 

M^(2,3) 

M^(2,4) 

M^(3,l) 

m£(3,2) 

M*(3,3) 

M^(3,4) 

M^(4,l) 

5^(4, 2) 

Mg(4,3) 

M*J(4,4) 


0 h 

e 


e^(i) 

5 e< 2) 

0g(3) 
t 5 c <4) 


wherein 


[5^(l,l)] iojo - Jj< c k t 0 ! 0 k ^» > * 2- 4„° - A*J«, J,J" - Ai|i J ° >] ; 


1 - ^O’^O - I o* 


R (2>1) 1 max(l f £-l) . = ” l n ^0 " A V* V/ >; 1 ~ X,2,...,N; 


io[ l 
j=l 


Ij*sgn(j-l)+jJ 


r a 


1 - 1 o - r o ; 1 - h - V 


sgn a = 


if a j 4 0 


R 

^ 0 if a = 0; 



29 


M*J(3,1) = 0; 
5^(4, 1) = 0; 
[*£(2,2)] 


max(l,£-l) max(l,p-l) 

Ij-sngCj-D+i^X^ ^‘sgnCk-D+ip) 


- S. §- < B.t p > - f <1 - a. 


'pi i y l ’ T p c 0 1 T 1 ’ p T p 


1 = 1 


..) (1-6. ) — 

xl ip e. 


•< Vi 1 ' Vp P >> 


[i?(3,2>] 


1 < P, 2 < N; 1 « l t « I , l « i„ « I„; 


max(l,5,-l) 


( *sgn( j-D+i^) (sgn(p-l) • (p-l)l 0 +i p ) 


i 


= “'V < v/' *„W >; 


1 < p,jl < N; 1 < i & < 1^; l < i < I Q ; 


[M" h (4,2)j 


( max(l,5.-l) gn(j _ 1) + . )( max(l,p-l) . 8gn(k _ 1)+i ) 

j=l J x k=l p 


■ - W -V k < vI**vJ p 5 1 


1 < p,2 < N; 1 < i A < I Q ; 1 < i p < I p - 


[*£(3,3)] 


(sgn(2-l)*(5>-l)I 0 + i^)(8gn(p-l)*(p-l)I 0 +i p ) 


- ? < c j+o S '. = j +o P > - h <*0* - %’’• % r - < >• 

3 


1 < p,2 < N; 1 < < I Q ; 1 < i < I p ; 
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[*$(4,3)] 


max(l,p-l) 

(sgn(£-l)* (£-l)I n +i 0 )( 2 I.*sgn(k-l)+i ) 

U * k=l k P 

= 6 *— < 4i n S '-Ai}; n ^,4)' p -A^' p > ; 

P£ £ 0 Y 0 v 0 ,v p y p 


1 < p,£ < N; 1 < < I Q ; 1 < i < I p ; 


$!«■«] 


max(l,p-l) gn( ._ 1) ( j. 

j"X J j= l 


.. ^a.p-n l-.j.ihm j 


• • • 

- -Vlf- < b A*-Vp P> ♦ <M A'V >3 ; 


1 < p,£ < N; 1 < < 1^; 1 < i < I p ; 


and Me(q,r) = (r,q) for q < r, l < q,r < 4; 

[§h e <1,] i„ * j^Wo” + f-<£, *£•-*(£•>; X<i 0 <X 0 ; 


K(2)j 


,m*x ( 1 , ^»“1 ) T ^ \ • \ 

( 2 I: •sgn(j-l)+x ) 

j-x j * 




1 < £ < N; l < < 1^; 


((£-l)*sgn(£-l)«I 0 +i^) - '*£* w £ y 0 ' Y 0 


p o • 1 p 1 o 

-< 2 o* c pV > v - A v >f 


1 < £ < N; 1 < i a < I Q ; 


t 6 (4) i max(l,£-l) 
( Z 
j=l 


Ij*sgn(j-l)+i^) 


<y l p . 

V £ ’ B £V >f 


1 < £ < N; 1 - i £ - I £' 



Theorem 2.4 


Let { } be a one-parameter family of finite element spaces 


as mentioned in (2.16). Let ^ x g» u e» X £» u e^ f S h t * ie 3 °i ut i° n of (2.18) 
Assume that (x £ ,u £ ;X £ ,v £ ) , the solution of (2.8) (or (2.2)), belongs to 


s x N s 2 Si.N N s 2 

H x( II H )x([h ] ) x ( H H ). Let (x,u;$,v) be the solution of (1.2) 

n tit • • tn w 


• i m • 
1-1 1 


• « in • 

1=1 i 


Under (HI) and (H2), we have 


(2.19) || - x\\ ^ + || u^ - u || y + ||X £ - X || ^ + II - v II D 


K 


< (1 + r ■— ? 


r 0^i<N e i 


3 )h u || (x £ ,v £ ;X £ ,v £ )|| 


si N s 2 s.N N s 2 
h x( n H )x[H ] x( n H ) 

i=l l 1=1 l 


+ K 2 ( o“?s e j)H ( P 0 .P)II r.21H+l 


63 


n 


for some constant Kg > 0 independent of h,£ and (x £ ,u £ ;X £ ,v £ ) , where 
U = min(Ty-l,T,s^-l,s 2 ), (p Q ,p) is the dual multiplier, and is the same 

constant as in (1.27). 


Proof : We use the triangle inequality 


( 2 . 20 ) 


~h <>h ^h . 
x £ ,u £ ;X £ , v £ ) 


- (x,u;£,v)|| 


H 


< II (x £ ,u £ ;X £ ,v £ ) - (x £ ,u £ ;X £ ,v £ )|| H + || (x £ ,v £ ;& £ ,v £ ) - (x,u;X,v)|| 






H' 


Since 


satisfies 
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s -ahr U+»h W« 

0<i<N 1 

for some K 0 > 0 for all d>, iJj 6 H, by assumptions (HI) and (H2), and 
o 

[l,p.l86], we have 

(2.2D || cs£,u£ii£,v£) - (vv^.VIl,, < u -sr - r > h ' 1 

0<i<N 1 

*1! (x £ ,v e ;X £ ,v e )|] Si N g 2 s x N N s 2 

H )UH )x[h 1 x( n h ). 

ri • 4 m « n • • iq * 

1=1 i 1=1 i 

with p = min( (^ q- 1) ,x >3! -1 ,s 2 ) . 

Combining (2.20), (2.21) and Corollary 1.7, we conclude (2.19). D 
From Theorem 2.4, we see that if 


Urn H (x e ,u e ;X £ ,v e )j| g 


< 00 


£ q . • • ..e^+0 


' °i =2 r S li^ ( ^ H 2 \ 

h x( n h )x( [h j ) x\n 
n . m. u n J 1=1 i 


then the error estimate is of the order of magnitude 


(2.22) II (S^a^.v*) - (*,u;X,J)|| 


<' 7 .Y 4 1 T + max e.), v e , V h. 


H \ • ("■ UtSA • 4 

mm £. - . l 

0<i<N 1 


Thus 


if we choose =e^ = ... = = e and e = {jP(h^ J//2 ), the RHS of 


(2.22) is optimal and we have 


|| (x£,G£;j£,v£) - (x,S;X,v)|| R =^(h U/2 ) 
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§3. Duality and Penalty 

The relationship between penalty has already been indicated in Theorem 1.2: 
we see that the Lagrange multipliers pg,...,p^ are actually the strong limits 
of (some scalar multiples of) the penalized differential equation, and the rate 
of convergence is (9(e). 

Let us explore this relationship a little further here. Consider, as in (2.2), 


(3.1) 


mm 


max 


(x,u)€Hj n XU (X , v) f [Hq^I N *U 


J e (x,u;X,v) 


N 


= — 2 [ C.x - z. 2 +<M.u.,u. > - C.x - z. -<M. v., v.> 

2 . , l l l i’ l l l l l* l 

1=1 


tr^ 

i 


-Ax 1 - 2 B.u. - B.v. - fll 2 ] + — || x - Ax -IB.u. - f|| 

jj*i J J 11 J V i 1 1 


We can regard the above as a primal rain-max problem subject to constraints 

• d *1 _ d 1 •N_dN_, - n , _ 

x=^-x, x x *•••» x = x . Thus, formally, we introduce Lagrange 

multipliers pg,p^, . . . ,p^ and consider 


(3.2) 


max min 


mm 


P 0 «4 


max L £ (p 0 ,p;x,u;X,v) 


(X,v)6[hJ; ] N xU 
On 


where 


N 


(3.3) 


L £ (p 0 ,p;x,u;X,v) 


d i * i 


= J £ (x,u;X,v) + < P 0 , dt x " x > + 2 < P," » 17 x " x > » 


i=l 


i» dt 


P a (Pj_ * • • • »Pjj) • 


For given Pg^ 
[4] , we get 


, . . . ,Pjj € H^g, proceeding formal variational analysis as in 
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VT ^ A -ff * • ^ 

Z {<C.(C.x_ - z.),5x> + <M.u 5u.> -<C.(C.x*; - z.), Sx 1 >- < M.v_. , <5v.> 
11 £ i’ 1 ^V 1L 1 ii£ r * i 5i ' i 


i=l 


~[<x?: - Axi: - Z B.u,,. - B.v„. - f, fixS - <A*(x~ - Ax* - z B.u . - f), Sx 1 
^ U e £ jjii J e *J 1 ^ - e * e J S-J 


E < B*(x £ - 4 - ^ B k u^ - B.O^ - f). 6u j >-<B*(xi - 4 - 




ksH 


• N • 

- BjV^ - f), Sv^>] } + j-[< x £ - Ax £ - ^ B j u ^j " f > Sx>- <A*(x £ - Ax £ 

- Z B.u . - f), <5x > - Z < B*(x P - Axp - £ B, u_, - f), <S U . > ] ~ <p n , <5x > 

j J £ P j =1 J e e k k 5k J ‘'O’ 


. N . . 

-< Zt p O’ 5x> “ 2 [<?£> 5xl > +< dt p i’ 5xl> J = 0 

i=l 


Thus, we get, for i = 1,2,...,N, 

(3.4) Z C^(C.x £ - z.) - k (x - Ax -ZBu -f)-j-p=0 
j 3 3 e 3 e Q e e j j £ 0 dt 


(3.5) - =i) + §7 A *&l - Ax* - .J. B j\j - B iV - f) - 3T Pi ■ 0 


(3.6) M.u . - B*- 

1 £1 £ q 


7(x Ax - Z B.u . - f) + z ~ [b*(x £ “ a£* - z B G 
1 £ j 2 V jjH £ i J e kH k 


5k 


“ B.G - £)] =0 


(3.7) -M.v . + — B*(x^ - Axf; - £ B u - B.v . - f) = 0 

i ^ e i i e e k 5 k 1 5i 


k£i k£ * 


2 A 

(3.8) -p n + 4- (x„ - Ax - Z B.u . - f) = 0 

0 e o E e i J 9 


(3.9) - Pi - §- (x^ - A^ - Z B.a - B.$ - f) - 0 , 1 < i < N. 

1 1 e e j^i J Si 1 9 - 



Substituting p^, p^,... 


,P N from (3.8), (3.9) into (3.4) - (3.7), we get 


(3.10) 

A i< ^ i< 

h "o ■ - A + .* °i < c 

i=l 

and for 

i = 1» 2, ..., N, 

(3.11) 

d * * , *i 

dt p i * " A p i - c i <c i x e ' 

(3.12) 

V “ M i lB i ( fo + .2. V 

(3.13) 

/\ -1 * 

v . = -M. B.p. , 

£l 1 1*1 


wherein for p^, i = 0, 1,..., N, the terminal conditions p^(T) = 0 has 
been imposed. 

Comparing (3.10), (3.11), (3.12) and (3.13), respectively, with [4, 
(3.9), (3.6), (3.10) and (3.7)], we find that they are correspondingly 
identical. If we assume as in [ 4, (Al)) that 

it 

(3.14) C i C i (1 < i < N) are positive definite, 
then we have 


(3.15) 

/V 

x e 

-1,. * 

= 5_ (p+Ap + ZC.z.)» 

0 .ii> 



i 

(3.16) 

• 

A 

x e 

= a{jCq^(p + A p + Z C^z^ 



i 

(3.17) 

^i 

x e 

1 ic it 

= -5. (p. + A p. - C.z. ) 

l *i *i ii 

(3.18) 

• , 

Al 

x e 

r -1 . • * * 

= A 1-5. (p. + A p. - C.z 

*• i r x *i i : 



„ -1 * e i 



- B.M. B.p. £ p., 

l l 1*1 2 *i* 


*0 = \ C i<V 


5. = C?C., 1 < i < N; 

i ii* - 


' 3 
1 < i < N. 


.jj.vJ + f 

kj*i 
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Integrating by parts for the last terms <Pqj x - jc> + 2<P^» 

i u 

in (3.3) and using (3.15) - (3.18) to substitute p^, p^, 0 < i < N for 

• • • 

A A A J A ^ aJJ A^J A A A a 

X £> X £> X £,***> X £> X £> > * * * » U qjj» V £^X ,, '* > 8®b 


• 1 

X > 


L (p } p) = min. max. L (p ,p;x,u;X,v) 

0 (x,u)€Hj n XU (X,v)€[Hy N xU £ 0 

“ J <P 0 + A*p 0 , .^(Jq + A*p Q )> + j + A*p i , !C i 1 (p i + A*p i ) > 


- 7<P 0 + £ P^ S(p Q + Z p^) +<p Q + Z Z B i M i 1 B*p i > 

i i i i 


it — 1 N ^ # ju — i ft 

- < p_ + A p„, <D 0 £ C.z. >- £<p. + Ap., iC. C.z. > 

^0 ^0’ 0 . . l l .1 *iiii 

1=1 1 

- < P 0 + £P i , f> “ I < «J 1( ? Vi). ? c i z i> + 7 ? II z i II 


~ J e o I i Pq II 2 + I ^illPill 2 . 


which differs from [4, (4.3)] only by - j |[ p Q [| 2 + J 2 || p^ || 2 . (The 

i 

term < Pq( 0 ) + £ p.(0), x^> vanishes because Xq = 0). These two terms do 
i 1 

not affect the convexity of p^ and the concavity of p in L £ (pQ,p). Thus 

we conclude that the dual of the penalized problem is just an e-perturbation 
of the dual problem . 

We compare briefly the amount of computing involved in the dual and the 
penalty methods. Assume that in the error estimate (2.19) and s 2 are 


sufficiently large and that 


lim || (x ) u 
£+0 



)ll 



< 00 . 
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For siraiplicity , we only consider n a = . . . a * 1. In order 
that x^, the penalty solution, converges to x with the same rate as 

H&k - x|| in [4, (6.21) ] (where x^ is the duality solution), we must choose 

e o “ s i = *•* " £ N '“^< h ^ /2 > 


, with y ® y in (2.19) and y a 2y, where y is the same y in [4, (6.21)]. 
This implies that 


T Q - 1 = T = y = 2y. 

Assume also that in [4, Theorem 6.2] that l is sufficiently large so that y = r 
Thus, using the same h = T/M in both approaches by dividing the interval 

[o,t] into M equal parts, the finite element space (in [ 4 ] Theorem 6.2) 

has (N + 1) . (My +1 ) basis elements, while the finite element space 

S h in (2.16) has (N + 1) * (2My + 1 ) + 2N[(2y-l) M + l] basis 

12 N ~ 

elements, assuming that = ... = = a (y,0)-system. Thus the 

corresponding matrix equations 

(3.19) M h 5 h » 0 h (cf. [4, (6. 10)]) 


(3.20) M^ q£ = ®h <2,18) 

have respective sizes 


[ (N+l) • (My+1) ] 2 

[(N+l) • (2My+l) + 2N(2y-l)M+2N] 2 


Thus the ratio of computing time between (3.19) and (3.20) is 


(3.21) 




(N+l) (My+1) 

(N+l) (2My+l)+2N(2y-l)*H-2N 
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It appears to us that even after we take into account the sparseness 
and block structures of the matrices and 

valid asymptotically. Therefore we see that the dual method is much more 
efficient than the penalty method, especially when the number of players 
N is large. 

Nevertheless, the dual method is feasible only under assumption 
(Al) in [4], which requires the invertibility of C 1 , . . . and is 
therefore quite restrictive. Computationally, the penalty method is 
not restricted by such a condition. 
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4. Numerical Results 

Example 1 We consider the very same example as in [4, §7, Example 1] 


(4.1) 



x(t) + Ul (t) + 2u 2 (t) + 1, 


x(0) ■ 0 


0 < t < T, T 




X 

J 1 (x,u) ■ / [| x(t) - (cos t + j)| 2 + J | Ul (t)| 2 ] dt 

J,(x,u) = / [|x(t) - sin t| 2 + 2|u_(t)| 2 ] dt, 

L 0 z 


IT/4 


which is a 2-person non zero-sum game and is known to have a unique 
equilibrium strategy for all T >0. 

J e (x,u;X,v) is given as in (2.1). We choose for a (x^,!) = (3,1) 


system of quadratic splines as approximation spaces for x, x and x , 

1 2 

and for S^, a (x,0) = (2,0) system of piecewise linear finite elements 

as approximation spaces for u i> u 2 ,v i an< * v 2 * 


It is not difficult to see that conditions (Bl) - (B5) and (B7) in 
§1 are all satisfied. We are, however, unable to verify (B6); similarly, 
nor are we able to verify the validity of (HI) and (H2) in §2. 

Our numerical results are plotted in the following figures . We 
use h = ^/32 and G 0 = E 1 ~ e 2 2 £ * 

-1 -2 -3 -4 -5 

In the first three figures, we use £ = 10 ,10 ,10 ,10 and 10 , 

respectively. 

Figure 1 contains graphs of u^, versus time t, for various values of e . 
Figure 2 contains graphs of u 2 * 

Figure 3 contains graphs of x. 

The trajectories of u^ u 2 and x versus various values of e cluster closer 
and closer as £ becomes small. 
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Figure 4 shows two graphs of u^. The solid line represents numerical 
data obtained from duality in [4] , with (4,l)-cubics and h 3 ^7 32. The 

broken line represents data obtained from penalty, with (3,l)-quadratics 
for state and (2,0) piecewise continuous linear elements for strategies 
also with h = |-/32, and £ q = e ^ = £ 2 “ 10 3 . 


Figure 5 shows two graphs of Uj, obtained in the same fashion as u^. 

- Figure 6 contains two graphs of x. 

From Figures 4 and 5, we see that numerical results for u^ and u^ obtained 

from duality and penalty show remarkable agreement. In Figure 6, we see 

that the two graphs of x agree very well everywhere except at the initial 

and terminal time 0 and T, where the duality graph is rougher and less 

accurate . 

1 2 

We list values of u i » u 2 ,v i ,v 2 ,x,x ,x at selected points in Table 1. 


All of our calculations were carried out with double precision. 


The values of J £ are obtained as follows 


J 3 0.5159708038688868 x 10 
e 


J P 3 0.5698840889975811 x 10 % 


J £ 3 0.8583978319547797 x 10 ", 


J e 3 0.3287468594749820 x 10 ", 


J £ = - 0.1245174244833003 x 10 ", 


-1 

> 

e 

= io " 1 

-1 

» 

e 

3 io ” 2 

- 3 , 

e 

3 io ’ 3 

-3 

> 

e 

ii 

t-* 

o 

i 

io" 3 , 

£ 

= io " 5 
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In the following table, we use h = "r/32 and use the following to denote 

-3 

P^: penalty solution with £Q=€^= e 2 = 10 
penalty solution with e o =£ l = £ 2 = ^ ^ 

D: duality solution 



rr 

II 

• 

t = I . I 

C 2 4 

t = l • 1 
4 4 

rr 

II 

4>|=1 

II 

H 

P 1 

-2.077473 

- 1 . 238577 

-0.562432 

0.000086 

P 2 

-2.078433 

-1.239262 

-0.562789 

-0.004539 

D 

-2.064450 

-1.229223 

-0.556116 

0.0 

P 1 

0.440848 

0.285103 

0.131847 

-0.000053 

P 2 

0.441103 

0.285264 

0.131923 

-0.002366 

D 

0.436094 

0.281693 

0.129746 

0.0 

P 1 

-0.125946 

-0.136808 

-0.053823 

0.118535 

P 2 

-0.125870 

-0.136707 

-0.053713 

0.118661 

D 

-0.126924 

-0.137191 

-0.053709 

-0.250000 


Table 1 

Remark: The above are rounded-off figures with 6 decimal place accuracy. 
Example 2 (The Primal-Finite Difference Method) 

We return to the primal approach in Part I [4]. Consider the same example as 
in Example 1: 

(4.2) min max J(x,u;X,v) 

(x,u) (X,v) 
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where (x,u;X,v) is subject to the differential constraints (DE) = 0, 

[deJ = 0, x(0) = 0, X(0) = 0. 

We discretize the differential constraints by the crude Euler finite 
difference scheme. For example, (DE) = 0 is discretized as 


(4.3) 


x(t i+ i) - x(t.) 


N 

= A(t.)x(t.) + Z B.(t.)u.(t.) + f(t.) 

3- 1 • 1 1 ] 1 X 

j=i J J 


i = 0, . . . ,M- 


Substituting (4.3) (and others) into (4.2), we proceed to solve the min-max 
problem. 

IT 

We use M = 32 and h = -jrl32 and the primal approach to compute Example 1. 
The following values are obtained at selected points: 



t = I • I 
4 4 

t =1.1 
2 4 

t . 3 . JL 

4 4 

t ■ y - T 
4 

U 1 

-2.0416074 

-1.2191050 

-0.5541710 

0.0 

U 2 

0.4394483 

0.2837087 

0.1311784 

0.0 

X 

-0.1244138 

-0.1363107 

-0.0565919 

0.1097617 


Table 2 


The reader may compare the values in Table 2 with those in Table 1, 


Example 3 : Consider again the following 2-person nonzero-sum game 


x(t) = x(t) + cos t • u 1 (t) + sin t • u 2 (t) +1, 0 < t < T, 

x(0) = 0, 

T 

^ ’j^x.u)^ / [ jx(t) - d 1 (cos t + |) I 2 + y u^(t)]dt, 


^ J (x,u) = / [ |x(t) - d 2 sin t | 2 + j u 2 (t) ]dt, 

Z 0 



where T ** 2ff and " (-1*0.9), as in [4, §7, Example 3]. It 

is not clear to us whether the assumptions in [4] or in this paper are 
satisfied by this problem. However, as noted in [4, §7, Example 3], the 
values of L seem to be divergent. 

Let us manage to compute the numerical solutions in a straightforward 
manner, using h “ 2tt/32. In Figures 7-9, the graphs of u ^» u 2 anc * * 

are plotted. The solid lines always represent the duality solutions of 

u^,^ and x, while the broken lines represent the penalty solutions of 

-3 -4 

u^, U2 and x, using e = 6 q = ■ 62 = 10 and 10 , respectively. 

It can be seen from these graphs that smaller values of e cause 
futher deviations between the penalty and duality solutions, if h is 
not adjusted according to s. This offers partial evidence that s and h 
are coupled in the error bounds (2.19). Compare the results in [3]. 

We have also plotted the graphs of u^, ^ and x, respectively, versus 

1 O Q M p 

t with s = 10 ,10 ,10 ,10 and 10 , in Figures 10, 11 and 12. 

The computed values of J are 

6 


-1 


J = 0.4582465783358920, s » 10 

O 

J - 0.2730100141206180, e - 10 

s 

J = 0.1231759476555612, e = 10 

s 

J » 0.9989590297527213, s = 10 
s 

J = 0.3011451125450394X10 3 , s - 10 _5 , 

s 


-2 


-3 


-4 


We see that when s = 10 3 , the "numerical solutions" become completely 
meaningless. □ 










1 


-1 

I 

H 



0 0 01 02 03 04 05 06 07 08 

TIME 


LEGEND ! 2 

Figure 4 : Comparison of the Penalty and Duality Solutions of u 




Throughout Figures 4, 5 and 6, the solid curve (1) represents the 


duality solution while the broken curve (2) represents the penalty 
solution, with £ o =£ l =£ 2 = ^ ^ » both use h = ^/32. 





2 3 4 5 6 

TIME 

LEGEND 1 2 


tween the Penalty and Duality Solutions of u^, e = 10 . 


STRATECY U2 I I no -29.10 23.21 75.52 



Figure 10 

Example 3 
values of 


u^ in 

for various 

e. 


TIME 


SI 


EPS2 *** 


EPS3 +++ EPS4 XXX EPS5 . . . 


SC 


I-* 



Figure 11 in 

Example 3 for 
various values 
of s. 


EPS1 . . 


EPS2 *** 


TIME 
EPS3 +++ 


EPS4 XXX 


EPS5 






Throughout Figures 10,11 and 12, we use 


EPS1 


- 10" 1 , 


EPS2 


= 10 ~ 2 , 


EPS3 - 


10 3 , 


EPS4 = 10 


-4 


and EPS5 = 10 


-5 
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